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Next  Generation  Image  Restoration  for  Space  Situational 

Awareness 
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Executive  Summary 

The  imaging  of  Earth-orbiting  objects  using  large  aperture  telescopes  equipped  with  adaptive 
optics  is  a  critical  component  of  Space  Situational  Awareness.  Unfortunately,  due  to 
limitations  in  the  adaptive  optics,  compensation  of  the  wavefront  distortions  imparted  by  the 
Earth's  turbulent  atmosphere  is  incomplete.  Achieving  the  quality  of  imagery  necessary  for 
high  confidence  monitoring  of  the  near  space  environment,  therefore  requires  the  use  of  image 
restoration  methods  to  remove  the  uncorrected  component  of  the  image  blur. 

We  have  developed  a  novel  blind  image  restoration  algorithm  for  use  with  data  obtained 
under  a  wide  range  of  imaging  modalities,  including  “long-exposure'’  diversity  imaging.  By 
capitalizing  on  new  forms  of  prior  information  (spectral  holes),  and  improving  the  synergy 
between  the  data  acquisition  and  image  restoration  processes  (through  using  wavelength-  and 
temporal  phase-diversity  channels),  we  have  significantly  extended  the  observing  conditions 
under  which  we  can  produce  high-fidelity  restorations  with  a  high  dynamic  range  These 
improvements  enable  two  new  capabilities  for  the  Air  Force’s  3-metcr  class  telescopes:  the 
imaging  of  faint  targets,  such  as  microsatellites  in  geosynchronous  orbit,  and  imaging  through 
strong  atmospheric  turbulence. 
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Introduction 


Two  important  capabilities  for  Space  Situational  Awareness  (SSA)  studies  with  the  Air 
Force’s  3-meter  class  telescopes,  are  the  imaging  of  faint  targets  and  imaging  through  strong 
atmospheric  turbulence.  The  former  facilitates  the  monitoring  of  the  health  and  safety  of  the 
U.S.  military  and  civilian  assets  in  geosynchronous  orbit.  The  latter  extends  both  the  spectral 
range  (from  the  infrared  into  the  visible  region),  and  the  range  of  turbulence  conditions  under 
which  we  can  obtain  high-quality  imagery  It  also  extends  the  area  of  sky  that  can  be 
monitored. 

The  foundation  for  achieving  these  capabilities  lies  in  the  efficient  removal  of  the  image  blur 
caused  by  observing  through  the  Earth’s  turbulent  atmosphere.  This  is  a  two-step  process.  The 
First  step  is  to  reduce  the  level  of  image  blur  and  improve  the  image  signal-to-noise  ratio 
(SNR)  by  employing  adaptive  optics  (AO)  in  the  imaging  system.  As  compensation  of  the 
distortions  in  the  incoming  wavefront  by  AO  is  only  ever  partial,  the  second  step  is  to  remove 
the  remaining  (residual)  image  blur  through  digital  image  restoration.  Because  the  point- 
spread  functions  (PSFs)  for  the  residual  blur  are,  at  best,  poorly  known,  the  algorithm  of 
choice  for  this  restoration  is  multi-frame  blind  deconvolution  (MFBD),  where  both  the  target 
and  the  PSFs  are  estimated  [1,2]. 

The  quality  of  the  restored  imagery  in  blind  restoration  problems,  which  are  typically  ill 
conditioned  and  ill  posed,  depends  on  the  amount  of  prior  information  used  to  constrain  the 
restoration.  In  general,  the  more  information  used  the  better  the  quality  of  the  restoration. 
Here  we  demonstrate  the  advantage  provided  by  using  a  physics-based  model  for  the  PSF  and 
applying  strong  constraints  on  its  pupil  plane  and  Fourier  plane  properties.  We  show  that  by 
doing  this,  we  can  significantly  extend  the  dynamic  range  and  spectral  region  over  which  we 
can  perform  successful  blind  restoration  of  imagery  obtained  under  a  wide  range  of  imaging 
modalities,  including  “long  exposure’'  imaging  (i.e.  the  integration  time  for  the  observations, 
Tin„  is  longer  than  the  atmospheric  coherence  time,  x0).  The  pupil  plane  constraints  come 
through  the  use  of  diversity  imaging  methods  [3,  4],  something  that  has,  until  now,  been 
reserved  for  “short-exposure"  observations  (i.e.  T,nt  <  x0).  The  Fourier  plane  constraints  come 
through  the  use  of  knowledge  of  the  sources  of  low  spectral  power  in  the  observations  (w  hich 
we  refer  to  as  “spectral  holes”). 


Temporal  Phase  Diversity 

The  amount  of  diversity  in  the  morphology  of  the  PSFs  during  a  set  of  observations  depends 
on  the  level  of  AO  compensation,  the  integration  time,  and  the  wavelength  of  the 
observations.  The  level  of  “PSF  diversity”  decreases  as  the  first  two  quantities  increase  and 
the  last  one  decreases.  Consequently,  although  AO  compensation  and  longer  integration  times 
can  improve  the  image  signal-to-noise  ratio  (SNR),  which  is  of  paramount  importance  when 
observing  faint  targets,  they  also  bring  a  new  challenge  from  the  blind  restoration  point  of 
view:  they  produce  PSF’s  that  are  remarkably  similar,  especially  when  observing  at  the  longer 
wavelengths  (see  Fig.  1).  This  similarity  weakens  the  advantage  provided  by  performing  a 
multi-frame  restoration,  where  the  separation  of  the  two  signals  that  comprise  a  measured 
image  (the  target  and  PSF)  leverages  off  the  diversity  in  the  PSFs. 

In  order  to  overcome  this  limitation  we  use  a  variation  of  the  traditional  phase  diversity 
method  during  the  data  acquisition  [3].  temporal  phase  diversity  Here  we  inject  a  temporally 
varying  phase  aberration  (magnitude  varies  in  time)  into  the  system  (as  opposed  to  a  static 
phase  aberration).  The  effect  of  such  an  injected  signal  is  to  increase  the  amount  of  diversity 
at  the  lowest  spatial  frequencies  of  the  PSF  (see  Fig.  2). 


2 


* 


Figure  1.  Two  separate  realizations  of  an  AO-compensated  PSF  at  red  (0.88  pm,  left)  and  blue  (0.44 
pm,  right)  wavelengths.  Here  the  integration  time  is  21  times  longer  than  the  atmospheric  coherence 

time  at  the  blue  wavelength 

However,  the  eost  of  this  boost  in  diversity  is  a  reduction  in  the  SNR  in  the  individual  data 
frames  due  to  the  sharing  of  the  photons  between  the  data  and  diversity  channels. 

We  note  that  when  using  phase  diversity  in  conjunction  with  wavelength  diversity  it  may  only 
be  neeessary  to  apply  the  temporal  phase  diversity  method  at  the  longer  wavelengths  (e.g.,  if 
there  is  sufficient  diversity  at  the  shorter  wavelengths). 


Wa  velength  Di versify 

Current  approaches  to  imaging  targets  in  geosynchronous  orbit  rely  on  observations  at 
infrared  wavelengths.  This  is  beeause  the  level  of  atmospheric  turbulence  is  less  in  the 
infrared  than  it  is  at  visible  wavelengths  and  AO  correction,  together  with  image  restoration, 
is  often  sufficient  to  provide  high-quality  imagery  However,  there  are  a  number  of  reasons 
why  we  would  like  to  be  able  to  observe  at  visible  wavelengths.  First,  the  image  resolution 
improves  at  shorter  wavelengths.  Seeond,  imaging  an  object  at  different  wavelengths  provides 
valuable  information  on  the  materials  present  in  the  target.  Third,  the  target  of  interest  may  be 
a  poor  reflector  at  infrared  wavelengths;  For  example,  solar  cell  material,  which  covers  the 
majority  of  the  surface  area  of  extremely  small  satellites,  has  a  peak  reflectance  at  blue 
wavelengths. 
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Figure  2.  The  solid  red  line  denotes  the  fluctuations  (diversity)  of  the  spectra  of  the  AO-PSFs  for  the 
scenario  {Tml/To=21 },  and  the  blue  dotted  line  denotes  the  diversity  after  injection  of  a  time-varying 
phase  signal  (±1  wave  of  spherical  aberration) 


Unfortunately,  at  shorter  wavelengths  the  coherence  length  of  the  atmosphere,  as 
characterized  by  the  Fried  parameter  r0,  decreases  and  the  turbulenee  strength  as  measured  by 
the  ratio  D/r0  (where  D  is  the  diameter  of  the  teleseope  aperture)  increases.  Eventually  the 
turbulenee  strength  reaehes  a  level  (D/r0~25)  where  AO  compensation  and  digital  image 
restoration  are  insufficient  to  provide  the  high  dynamic  range  imagery  required  for  faint  target 
detection  thus  limiting  the  spectral  range  over  whieh  we  can  observe  a  target.  Fortunately, 
wavelength  diversity  [4]  offers  a  mechanism  to  observe  targets  at  shorter  wavelengths  than 
would  be  normally  attempted  with  a  large  aperture  teleseope.  The  underlying  principle  behind 
wavelength  diversity  is  straightforward,  by  observing  simultaneously  at  multiple  wavelengths 
we  can  capitalize  on  the  fact  that  the  wavefront  phases  at  each  wavelength  are  linked  through 
a  common  optical  path  difference  [4].  Because  of  this,  observations  made  at  longer 
wavelengths,  where  the  turbulenee  conditions  are  more  benign,  provide  a  strong  constraint  on 
the  low-spatial  frequencies  of  the  wavefront  phase.  This  effectively  anchors  the  low  spatial 
frequencies  of  the  wavefront  and  enables  the  restoration  algorithm  to  extraet  the  high-spatial 
frequencies  of  the  w  avefront  phases  from  the  shorter  wavelength  observations. 

Lastly,  when  using  phase-diversity  methods,  observing  simultaneously  at  multiple 
wavelengths  allows  us  to  inject  a  different  phase  aberration  at  each  wavelength,  thus  further 
leveraging  the  phase  diversity. 


Spectral  Holes 

An  important  observable  in  the  spectrum  of  the  data  are  spatial  frequencies  that  have  low 
Fourier  power.  Because  of  the  lack  of  information  at  these  frequencies,  we  refer  to  them  as 
spectral  holes.  Spectral  holes  in  the  data  occur  where  there  are  spectral  holes  in  the  spectra  of 
both  the  PSF  and  object  (see  Eq.  1.3).  Fortunately,  it  is  possible  to  determine  the  source  of 
each  observed  speetral  hole  in  the  data.  Due  to  the  random  nature  of  the  atmospheric 
turbulenee,  speetral  holes  from  the  PSF  will  change  location  with  time,  while  those  from  the 
target  will  remain  static.  By  forming  the  ensemble  spectrum  of  the  data,  the  spectral  holes 
from  the  PSFs  (whieh  move  with  time)  average  out,  leaving  only  those  due  to  the  object 
spectrum  Knowing  these  it  is  then  straightforward  to  determine  the  spectral  holes  in  the  data 
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that  come  from  the  atmospheric  PSFs  (sec  Fig.  3).  This  information  provides  a  constraint  on 
the  spectra  of  the  estimated  object  and  PSFs.  The  density  of  PSF  spectral  holes  increases  as 
D/r0  increases.  At  infrared  wavelengths,  where  D/r0  is  small  (~  5  or  less),  there  are  very  few 
spectral  holes  and  the  effect  of  applying  a  PSF  spectral  hole  constraint  is  minimal.  However, 
when  D/r0  is  large  (>25)  knowledge  of  the  locations  of  the  PSF  spectral  holes  provides  a 
strong  constraint  on  the  PSF. 


Figure  3.  T  op  Left:  Average  power  spectrum  of  an  ensemble  of  images  of  a  target  observ  ed  at  0.4  pm. 
Top  Right  Binary  map  where  white  shows  regions  of  high  power  in  the  average  power  spectrum  of  the 
data  and  the  black  regions  correspond  to  “object  spectral  holes”  Bottom  left-  Power  spectrum  of  a  PSF 
used  to  simulate  the  observed  images.  Bottom  Right.  The  product  of  multiplying  the  power  spectrum  of 
the  observation  corrupted  by  the  PSF  corresponding  to  the  spectrum  shown  in  the  bottom  left  panel,  by 
the  binary  map  in  the  top  right  panel.  The  dark  regions  show-  the  locations  of  low  spectral  power  in  the 
PSF  (“PSF  spectral  holes”)  that  are  coincident  with  those  of  high  spectral  power  in  the  object. 


We  note  that  the  value  of  the  PSF  spectral  hole  constraint  is  diminished  (but  not  negated) 
when  wavefront  sensor  data  are  used  as  a  constraint  in  the  restoration  process.  This  is  because 
these  data  inherently  contain  the  spectral-hole  information  for  the  PSFs. 


Image  Restoration  Algorithm 

Here  we  describe  our  new  MFBD  restoration  algorithm  The  algorithm  is  capable  of 
processing  data  obtained  under  a  wide  variety  of  imaging  modalities  including  wavelcngth- 
and  phase-diverse  imaging,  and  “long  exposure”  imaging. 
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Modeling  the  Image  Data 

We  restrict  our  attention  to  imagery  obtained  under  isoplanatic  conditions,  that  is,  PSFs  that 
are  spatially  invariant.  In  this  ease  the  target  and  image  intensity  distributions, 

/(x)andg(x)  ,  are  directly  related  by  the  convolution  integral 

s(x)  =  J/Kx-xVXxVV-  (i.i) 

Here,  h(x)  is  the  incoherent  PSF  and  the  vectors  X,x  1  denoting  position  coordinates  in  the 
image  and  object  planes  respectively.  In  practice,  we  detect  and  restore  the  image  of  the 
target  on  a  discrete  array  of  pixels,  so  it  is  convenient  to  express  Eq.  (1.1)  as  a  discrete  sum.  In 
addition,  as  we  want  to  accommodate  the  restoration  of  data  obtained  using  the  diversity 
imaging  methods,  we  rewrite  Eq.  (11)  as 

=  X  fx  (x  Wx*  (x  -  X ')  +  (x).  (1.2) 

x' 

Here,  the  subscripts  k ,  <pt  k  index  the  wavelength  channel,  phase  diversity  channel  and 
observation  timeslot  respectively.  The  function  nX(pk  (x)  represents  an  additive  random  noise 

associated  with  the  detection  process  in  each  wave/diversity  channel.  The  vectors  X,  x  'each 

denote  pixel  locations  in  the  image  and  target  intensity  distributions.  Equivalently,  the 
observed  Fourier  spectra  have  the  following  representation  in  the  Fourier  domain, 

GAVk  (u)  =  Fx  (U)tf^  (u)  +  (u),  (1.3) 


where  the  vector  U  denotes  a  discrete  spatial  frequency.  Our  MFBD  algorithm  estimates  the 
target  scene  at  each  observation  wavelength  and  the  atmospheric  PSFs  corresponding  to  each 
of  the  wave/diversity  channels,  such  that  the  predicted  model  gX(pk  (x)  matches  the  observed 

data^(x)- 


PSF  Model 

We  model  the  incoherent  PSF  in  each  wavc/diversity  channel  at  timeslot  k  as. 


|J=0  i  f  Tint  <i0 
|  J=int(Tint/x0)-l,  otherwise 


where  ctX(p)k  (x)  is  the  coherent  PSF  and  j  indexes  its  instantaneous  realization,  and  *  denotes 

complex  conjugation.  The  coherent  PSF  is  the  inverse  Fourier  Transform  of  the  complex 
wavefront  in  the  telescope  pupil, 

d  Xtpjk  «=-4s  4t  Jt  (p)  exp[-/^wt  (p)]  exp[-27z-zp  •  x] . 

^  P 


(14) 


(1.5) 


6 


Here.  AAjk{ p)and  <Pxyik  (p)  denote  the  amplitude  and  phase  of  the  wavefront,  the 
vector  p  denotes  a  position  coordinate  in  the  pupil  plane,  and  N  denotes  the  linear  size  of  the 
pixel  grid  We  assume  that  perturbations  in  the  wavefront  amplitude  are  negligible  [8]  and 
thus  the  amplitude  is  set  to  unity  inside  the  pupil 
In  each  wave/diversity  channel,  we  model  the  wavefront  phase  as, 


KA  p)  = 


(2 n 

A 


^y*(p)  +  VV(p)» 


where  y/^*(p)  is  a  certain  realization  of  an  injected  phase  signal  during  timeslot  k  and 

W jk  (p)  denotes  the  atmospheric  optical-path-differences  common  across  all  wave  channels 
[4].  The  optical  path  differences  at  time  j  in  turn  are  modeled  using  an  orthogonal  basis  set  of 
functions  |Z)^(p)|  defined  on  a  circular  domain, 

p)=£^<p)’ 

where  Cqjk  denotes  the  weight  of  each  function  in  the  basis.  We  have  used  Disk  Harmonic 

functions  for  our  basis  set,  since  they  behave  better  near  the  edges  of  the  pupil  than  the 
commonly  used  Zernike  functions  [5]. 

We  note  that  this  model  for  the  PSF  is  extremely  versatile  and  is  appropriate  for  short  or  long- 
exposure  imagery,  with  or  without  phase-/wavelength-diversity  data  channels.  Previously, 
diversity  imaging  [4,  5],  which  puts  strong  constraints  on  the  wavefront  phase,  was  restricted 
to  short-exposure  imagery.  Furthermore,  with  this  model  for  the  PSF  it  is  straightforward  to 
incorporate  any  prior  information  we  may  have  on  the  complex  wavefront  in  the  pupil  (c.g., 
wavefront  sensor  data). 


(1.6) 


(1.7) 


Object  Model 

We  model  the  target  scene  at  wavelength  X  using. 


fAx)  =  n/(x), 


(1.8) 


where  f/^x)  are  parameters  (pixel  intensity  values)  in  the  minimization.  This 
parameterization  ensures  positivity. 


Spectral  Holes  Constraint 

We  identify  spatial  frequencies  in  the  data  with  low  Fourier  power  as  spectral  holes.  From  an 
ensemble  of  data  we  can  distinguish  and  identify  the  holes  that  are  due  to  the  spectrum  of  the 
target  scene  and  those  due  to  the  random  atmospheric  PSFs 
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We  first  identify  spectral  holes  due  to  the  target  by  computing  the  signal -to-noise  ratio  in  the 
ensemble  averaged  power  spectrum  of  the  data. 


SNR,(u) 


(1 

) 

var 

[|G,(»)| 

,jl/2 

Spatial  frequencies  with  a  SNR  below  some  threshold  value  Tf  (we  used  a  value  of  3)  are 
identified  as  objeet  speetral  holes.  A  binary  mask  that  identifies  these  holes  is  created  for  each 
wave  channel, 


(1.9) 


10,  if  SNR,  (u)  >7; 

M\  (u)  =  <  A  ' 

[  I,  otherwise. 

Once  the  object  holes  are  known,  the  spectral  holes  in  each  data  frame  due  to  the  atmospherie 
PSF  are  identified  at  frequencies  where  (ll)  =  0  ,  by  computing  for  each  frame  the  ratio 

of  the  image  power  speetrum  to  the  standard  deviation  of  the  noise  power  (computed  at  spatial 
frequencies  beyond  the  diffraction-limit  cut-off  frequency).  A  binary  mask  that  identifies  the 
PSF  speetral  holes  is  then  defined  as, 


(1.10) 


<*(«)= 


0, 

1,  otherwise 


where  TH  is  a  threshold  parameter  (we  use  a  value  of  3). 

We  enforce  know  ledge  of  the  target  spectral  holes  via  the  penalty  function, 

Sp  =ZlMf(U)|A(u)f. 

A  u 


In  addition  to  providing  a  constraint  on  the  spectrum  of  the  reconstructed  object,  eF  also 
provides  a  natural  regularization  on  the  objeet  as  it  suppresses  noise  amplification  in  regions 
of  low  spectral  power. 


Similarly,  we  enforce  knowledge  of  PSF  spectral  holes  for  each  of  the  wave/diversity 
channels,  via  the  penalty  function, 


SH 


=XXX-vOu) 


A,  (p  k 


H 


A<pk 


Parameter  Estimation 

We  obtain  estimates  of  the  parameters  describing  the  PSFs  {<vl  and  the  target  scene 
| (*)}  by  using  a  conjugate  gradients  algorithm  [6]  to  minimize  the  error  function. 


(1.11) 


(1.12) 


(1.13) 
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(1.14) 


£  =  Z  X  Z rl*  (X)+«^F  +  «//*/, 

A  ,<p  k  x 


where 


'*»(*)  =  «**(*)* 


g^(x)-^(x) 

v  +  J 


Here,  /W^(x)  is  a  binary  mask  with  zeros  at  locations  of  bad  pixels  or  pixels  with  low  SNR 

in  the  data.  The  term  gA(pk  (x)  and  <7~  in  the  denominator  represent  the  Poisson  and 

Gaussian  components  of  the  noise  variance,  respectively.  The  parameters  OCh  and  aH 
denote  scalars  that  set  the  strength  of  the  penalty  functions  in  the  minimization. 


We  note  that,  ideally,  the  error  functions  in  Eq.  (1.14)  should  mimic  probability  density 
functions  (i.e.  they  integrate  to  unity)  so  that  each  term  is  optimally  weighted  with  respect  to 
the  others  However,  it  is  not  always  practical  to  achieve  this  requirement  and  the  weights  for 
each  component  must  be  determined  that  will  provide  the  best  solution  Here  we  have  chosen 


values  for  OCH  such  that  the  gradient  norms 


ds 


8c 


qjk 


and 


dt:,. 


dc 


qfk 


have  close  to  the  same 


magnitude  at  the  start  of  the  minimization.  In  the  same  manner  we  chose  a  value  for  (X f 


such  that 


dz 

and 

de,.. 

dt1x(x) 

dnAx) 

also  have  equal  magnitudes.  Wc  have  found  that  this  results 


in  an  adequate  balancing  between  fitting  the  data  and  enforcing  the  constraints  on  spectral 
holes  in  the  target  scene  and  atmospheric  PSF  estimates.  We  have  also  found  that  the 
approach  of  alternating  the  minimization  between  the  object  and  PSF  parameters  provides  a 
more  robust  algorithm  than  when  minimizing  for  both  sets  of  parameters  at  the  same  time  [9]. 


We  note  that  although  blind  image  restoration  algorithms  estimate  both  the  object  and  the 
PSFs,  they  should  always  be  used  with  the  best  possible  initial  estimates  for  these  quantities. 
For  example,  for  data  where  Tint  >  t0  it  is  important  that  there  is  some  diversity  in  the  initial 
wavefront  phase  estimates  used  for  each  PSF.  Without  diversity  in  the  input  phases  (e.g., 
using  zero  phases  for  the  initial  guesses)  the  algorithm  falls  into  a  local  minimum  early  on 
during  the  minimization.  We  have  found  that  use  of  random  tip-tilts  avoids  this  problem.  For 
the  initial  estimate  of  the  object,  it  is  important  that  there  are  no  areas  of  low  or  zero  signals 
where  there  could  conceivably  be  signal.  This  is  because  the  parameterization  used  to  enforce 
positivity  inhibits  the  recovery  of  signal  in  areas  that  are  close  to  zero  [10]. 


(1.15) 
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Results 


Here  we  demonstrate  the  performance  of  our  new  MFBD  algorithm  for  two  cases  important 
for  SSA. 

/.  Imaging  Through  Strong  Turbulence 

Here  we  present  restorations  of  simulated  short  exposure  AO-imagery  as  would  be  obtained  in 
strong  atmospheric  turbulence  (D/r0=  80).  The  severity  of  the  image  degradation  for  this 

level  of  turbulence,  which  is  at  least  a  factor  of  three  more  severe  than  is  typically  addressed 
in  the  restoration  of  ground-based  imagery,  is  highlighted  in  Fig.  4.  When  running  MFBD 
algorithms  on  data  obtained  in  this  regime  of  turbulence,  the  algorithm  will  typically  stagnate 
due  to  the  plethora  of  local  minima  in  the  parameter  space  [7].  An  example  of  entrapment  in  a 
local  minimum  that  is  far  from  the  global  minimum  is  shown  on  the  left  in  Fig.  5.  Steering  the 
algorithm  away  from  the  local  minima  requires  the  use  of  prior  information:  the  more 
information,  the  better. 

Our  strategy  is  to  image  the  object  simultaneously  at  multiple  wavelengths,  thereby  enforcing 
a  common  optical  path  difference  constraint  on  the  PSFs,  and  to  enforce  the  spectral-hole 
constraint  for  both  the  objects  (one  for  each  wavelength)  and  the  PSFs.  The  improvement  in 
image  quality  when  using  this  approach  is  demonstrated  in  the  right-hand  panel  of  Fig.  5.  This 
image  shows  that  with  sufficient  prior  knowledge  it  is  possible  to  extract  meaningful 
information  from  data  that  would  have  otherwise  be  discarded  as  “unusable''. 


Figure  4.  Left:  Simulated  diffraction-limited,  image  of  the  Hubble  Space  Telescope  (HST).  Right 
Simulated  observation  of  the  HST  as  viewed  at  0.4  pm  with  a  3.6m  teleseope  through  strong  turbulence 
(D/r0  -  80).  The  field-of-view  here  is  larger  than  for  the  left  hand  panel.  The  details  of  the  simulation 

are  provided  in  the  appendix 

This  improved  ability  to  restore  imagery  obtained  through  strong  turbulence  conditions  means 
that  we  are  able  to  dramatically  extend  both  the  spectral  range  (r0  decreases  with  decreasing 
wavelength,  consequently  D/r0  is  larger  at  visible  wavelengths  where  r0  is  typically  a  few 
centimeters)  and  the  range  of  turbulence  conditions  for  successfully  identification  and 
monitoring  of  spaced-based  targets. 
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X 


Figure  5.  Left;  Result  of  restoration  of  D/r0=  80  data  shown  in  Fig.  4  without  using  speetral-hole 
information  during  the  restoration  process.  Right:  Result  of  restoration  using  speetral  holes  and 
observations  at  to  wavelengths  (0  4  pm  and  1 .6  pm). 


//.  Imaging  Faint  Targets 

Here  we  simulated  observations  of  a  communications  satellite  (AN1K-F2)  in  geosynchronous 
orbit,  as  observed  with  a  3.6m  telescope  equipped  with  adaptive  opties.  The  simulations  are 
based  on  real  observations  of  ANIK-F2  made  with  the  University  of  Arizona’s  6.5  m  Multiple 
Mirror  Teleseope  [11].  To  establish  our  ability  to  detect  extremely  faint  targets,  we  have 
surrounded  the  communications  satellite  in  our  simulation  by  a  number  of  mierosatellites  with 
linear  sizes  varying  between  lOem  and  lm  These  unresolved  targets,  whose  surfaces  are 
modeled  to  have  the  same  reflectivity  as  solar  cell  material,  represent  magnitude  +14.75  to 
+  11,5  targets,  respectively.  The  full  details  of  the  simulation  are  given  in  Table  1  in  the 
appendix. 

Figure  6  demonstrates  how  the  image  quality  improves  as  the  level  of  prior  information  on  the 
PSFs  is  increased.  The  highest  quality  restoration  is  obtained  when  using  wavelength-  and 
phase-diverse  observations  along  with  wavefront  sensing  data  and  PSF  speetral  holes  to 
eonstrain  the  modeling  of  the  PSFs.  We  find  that  the  temporally  varying  phase-diversity 
signal  facilitates  better  estimation  of  the  low  spatial  frequencies  of  the  target-  this  is  evident  in 
the  bottom-right  panel  of  Fig.  6  where  the  background  is  eleaner  and  there  are  less  restoration 
artifaets  than  in  the  top-right  and  bottom-left  panels.  We  note  that  there  is  a  eost  for  including 
a  phase  diversity  ehannel,  a  reduction  in  the  signal -to-noise  ratio  of  the  data  due  to  the 
splitting  of  the  incoming  photons  between  the  data  and  diversity  channels.  However,  as  shown 
in  Fig.7  we  ean  compensate  for  this  loss  of  signal-to-noise  ratio  by  extending  the  total 
integration  of  the  observations.  Figure  7  shows  that  with  sufficient  integration  time  and  the 
use  of  diversity  imaging  methods,  we  ean  both  obtain  a  high-resolution  image  of  the  primary 
target  and  deteet  several  of  the  mierosatellites  that  would  have  otherwise  remained  invisible 
Moreover,  by  observing  at  multiple  wavelengths  we  gamer  confirmation  of  the  detection  of 
these  miero-satellites. 
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Discussion 


Even  at  the  best  observing  sites  (e.g.,  Mt.  Haleakala),  the  turbulence  conditions  can  change 
rapidly  with  time  and  prevent  high-resolution  imaging  of  targets  for  a  large  fraction  of  the 
day  In  addition,  even  if  the  observing  conditions  are  excellent  when  viewing  near  zenith,  they 
typically  deteriorate  quickly  as  we  move  away  from  zenith  toward  the  horizon.  Thus,  the 
ability  to  image  through  strong  turbulence  is  essential  if  we  are  to  extend  the  time  and  area  of 
sky  over  which  we  can  successfully  identify  and  monitor  space-based  targets.  Furthermore, 
with  the  rapidly  growing  number  of  extremely  small  satellites  in  orbit,  it  is  becoming  more 
and  more  important  to  be  able  to  monitor  extremely  faint  targets,  especially  foreign  satellites 
that  may  be  in  proximity  to  U.S.  assets. 


Figure  6.  This  figure  shows  the  improvements  in  detection  capability  when  injecting  prior  information 
on  the  wave- front  phase  into  the  image  restoration  process.  Top  left:  mean  “long  exposure”  (3  seconds) 
image  at  0.4  pm.  Top  right:  restored  image  using  recorded  wave-front  sensing  (WFS)  data.  Bottom 
Left:  restored  image  using  WFS  data  and  wavelength  diversity  (WD)  data  (i.e.  simultaneous 
observations  at  0.4  pm  and  1.6  pm).  Bottom  right,  restored  image  using  WFS,  WD  and  phase  diverse 
(PD)  data  (temporally  injected  +/-  1  wave  of  spherical  aberration).  The  raw  AO  image  tentatively  shows 
the  presence  of  two  (perhaps  three)  companions  to  the  main  satellite.  The  restored  imagery 
unambiguously  shows  the  presence  of  five  companions.  For  the  WFS  +  WD,  scenario  we  are  able  to  see 
the  faint  25  cm  targets  (see  appendix  for  aberration-free  image  for  comparison)  but  we  also  see  several 
artifacts.  For  the  WFS+WD+PD  scenario,  we  have  lost  the  ability  to  see  the  25  cm  objects  (most  likely 
due  to  the  reduction  in  the  SNR  of  each  individual  data  frame  due  to  the  splitting  of  the  photons  for 
phase  diversity)  but  we  find  a  dramatic  reduction  in  the  number  of  artifacts  and  the  level  of  the  residual 
halo  around  the  main  satellite.  That  is,  using  all  the  available  constraints  improves  the  resolution  and 
decreases  the  probability  of  false  detection.  Note,  the  images  are  displayed  on  a  logarithmic  scale  to 
emphasize  the  low-level  structure. 
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Figure  7.  A  demonstration  of  how  extending  the  observation  period  improves  the  detection  sensitivity. 
Here  the  restored  images,  at  0.9  pm  (left)  and  0  4  pm  (right),  are  based  on  77  seconds  of  simulated  data 
including  WFS  and  wavelength  diversity  measurements.  The  25  cm  x  25  cm  targets  at  a  distance  of  150 
m  from  the  main  satellite  (5  o’clock  and  -9  o’clock  positions)  arc  now  identified  with  a  high  degree  of 
confidence  (i.e.,  the  probability  of  false  detection  is  low  because  the  target  is  clearly  detected  at  two 
widely  separated  wavelengths).  In  addition,  the  improved  resolution  at  0.4  pm  has  enabled  the  clear 
detection  of  an  object  close  to  ANIK-F2  at  the  9  o’clock  position.  Wc  have  used  a  logarithmic  scale  for 
the  images  to  emphasize  the  low-level  structure.  For  comparison,  we  show  the  undistorted  “truth”  object 
in  the  appendix. 

We  have  developed  a  novel  blind  image  restoration  algorithm  to  address  these  issues.  To 
ensure  versatility  we  have  designed  the  algorithm  for  use  with  data  obtained  under  a  wide 
range  of  imaging  modalities,  including  “long-exposure'’  diversity  imaging.  By  capitalizing  on 
new  prior  information  (spectral  holes),  and  improving  the  synergy  between  the  data 
acquisition  and  image  restoration  processes  (through  using  wavelength-  and  temporal  phase- 
diversity  channels),  we  find  that  we  can  significantly  extend  both  the  level  of  atmospheric 
turbulence  under  which  we  can  produce  high-fidelity  restorations  and  the  dynamic  range  of 
the  restorations.  Together  these  improvements  provide  a  potential  breakthrough  for  Space 
Situational  Awareness  using  the  Air  Force’s  3-meter  class  telescopes. 
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Appendix:  Details  of  Numerical  Simulations 


a)  Strong  Turbulence  Simulation 


Turbulence  conditions 

Kolmogorov  turbulence 
r0=4.5  cm,  x0=8  msec  (at  0.4  pm) 

Level  of  AO  correction 

30%  of  first  50  modes 
(Gives  a  Strehl  of  0. 1 0  at  0.9  pmR 3 
and  0.02  at  0.4  pm) 

Telescope  aperture 

3.65  m 

Observing  wavelengths 

0.88  pm  and  0.44  pm 

Integration  time/frame 

8  msec 

Total  observing  time 

640  msec 

CCD  read  noise 

8  e' 

Main  target 

(Linear  size,  magnitude) 

13.2m  x  4.2m;  mag+3 
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b)  Faint  Target  Simulation 


Turbulence  conditions 

Kolmogorov  turbulence 
r0=15  cm,  x0=12  msec  (at  0.5  pm) 

Level  of  AO  correction 

30%  of  first  50  modes 
(Gives  a  Strehl  of  0. 1 0  at  0.88  pm 
and  0.02  at  0.44pm) 

WFS  Data 

Measurements  of  first  50  modes 

Telescope  aperture 

3.65  m 

Observing  wavelengths 

0.88  pm  and  0.44  pm 

Diversity  phase 

±1  wave  of  spherical  aberration  injected  as  a  sinusoidal  wave 
of  period  4  secs. 

Integration  time/frame 

384  msec 

Total  observing  time 

3  secs 

CCD  read  noise 

8e‘ 

Main  target 

(Linear  size,  magnitude) 

50m  x  5m;  mag+9 

1  0  m*t«r  $  100  m 


0  76  m«ter  @  100  m 


0.76  meter  @60  m 


0  .5  meter  @  40  m 
0  25  meter  @50  m 


0.1  meter  @  150  rr» 


0  25  meter  @  150  m 


0  1  meter  @  70  m 


♦ 

0  5  meter  @  100  m 

0  1  meter  @  100  m 


0.5  meter  @  150  m 


0.26  meter  @  160  m 


Figure  A.  1.  This  shows  the  diffraction-1  united  true  scene  at  0.44  jam  for  the  faint  target  simulation;  a 
model  of  the  communications  satellite  Anik-F2  surrounded  by  microsatellites  of  varying  size  and 
distance  away.  The  display  scale  is  logarithmic. 
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